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TIME BASED MULTIMEDIA OBJECTS STREAMING APPARATUS AND 

METHOD 

BACKGROUND AND FIELD OF THE INVENTION 

This invention relates to the transmission of real time data 
5 between a sender and receiver over a transmission network. 

The current delivery of real-time data depends very much on the 
feed back channel from the receiver to the sender which provides a report on 
^ the received data transmission. Based on this feedback report, the sender will 

J: take appropriate action for the transmission of subsequent data to the receiver. 

10 The action taken by the sender may require reservation of more network 



R3 



^ resources for end-to-end data delivery and re-transmission of lost data. Re- 

5 transmission of lost data requires the receiver end to report specifically the 

£ a 

M- amount of lost data encountered before the entire data can be of use to the 

i — 

bj applications at the receiver end. For a large system having a large number of 

xses. 

u 

p 15 servers and clients, the report messages between the terminals utilise a 
considerable amount of bandwidth. 

In both connection and connectionless data networks, data 
packets at the lower layers such as the network layer differentiate data only by 
priority or time-to-live parameters. The distinction made between data packets 
20 at the network layer does not relate the coupling nature of the application layer 
data fragmented into data packets for network layer delivery. Some of these 
data packet parameters used to distinguish the various classes of service 
between data packets are listed in the IETF (Internet Engineering Task Force) 
RFC 791 on Internet Protocol version 4 and lETF's RFC 2460 on Internet 
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Protocol version 6. In the current specifications for Differentiated Service as 
mentioned in lETFs RFC 2474, RFC 2475, RFC 2597 and RFC 2958, only a 
means to provide data packet marking is provided. IP data packets with special 
marking allow the network components such as routers or switches to treat the 
5 IP data packets based on the packet's different Quality of Service fields or 
DSCP, as an indicator on how data flow should be determined. The re- 
transmission and dropping of data packets belonging to a specific stream is 
performed at the IP packet level without any knowledge of the application data. 
O Data packet differentiation is only performed at the packet level and selective 

w 4 10 dropping of a group of data packets is almost impossible if this process has to 
be performed at the network level. 

Without the additional information from the application software, a 
jf * data packet that makes it though the network may consist of only part of the 

[7 data the application software needs. With the re-transmission of the missing 

K 15 data that finally arrives at the receiver end, a strict real-time requirement in most 
instances cannot be met. A data object that arrives not adhering to the real- 
time requirement is said to be of no presentation value because the time for 
decoding the piece of information has already passed. As a result, network 
resources are used in delivering real-time data of no value to the end user. In 
20 addition, the non-presentation value group of data packets may cause 
unnecessary network congestion at the already strained intermediate network 
nodes. In many instances the congestion of network traffic may be prolonged 
and in a worst case scenario the traffic congestion may spread to a wider area. 

For most real-time data streaming across a packet data network, 
25 the decoding rate for the data is only made known to the end devices, for 
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stance the -v- - ~ end den, m many — , the server ca * 

from the clien, giving statistics of the data -Wed. >n some implementation s, a 
,a^e data buffer or an « - - data bu«er needs to be 
J di en, side before the streaming - data from the server .o the *n, ca 
beg , ln w scene,* where . - " * constructed besed on 
num ber of intermediate network no.es such as routers an. 
h ave no in— on me type of data and now the data should be ,ea,ed - 
end-,c-end deliver, the intermediate nodes nave no real-time streaming 
pledge o, the networ* packets arriving and leaving the nodes. ,n me even, 
network congest a, one - the in—a nodes, there is no means to 
de ,iver or re-schedu.e the deiivery of network da ta packets the, makes sense 
fr om ,he view of the eppi.oe.ion da,a. In most oases, on,y a partia, object data ,s 
successfully deiivered ,o the end terminals and re-transmission of ios, data may 
be performed automatically by the network layer. 

SllMMftPV nn THE INVBffllOM 

According to the invention in a firs, aspect, there Is provided e 
m e,hod of sending . data object through a communications network from a 
sender to a recipient via at least one network node comprising the steps of: 
a. dividing me data obiec, into a stream of data packets to be transmitted, 
b marking each data packet with a delivery time; a nd 
c. dlscerding . said date pecke. en route when ,he delivery time of the se,d 
packet cannot be met. 
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According to the invention in a second aspect, there is provided a 
method of creating synchronised time stamped multimedia objects comprising 
the steps of: 

a. fragmenting the data objects into one or more data packets; 
5 b. marking each data packet containing a part or full portion of a single 
multimedia object using a unique reference; 

c. creating a link for related fragmented network data packets originating from 
the same multimedia object using an object reference before transmission; 

d. stamping the data packets related to the object reference with a time 

H 10 reference marking the instance the data packet leaves a transmission node; 

'H 

fy e. attaching a precedence level of the object based on the object reference. 

cP 

I" According to the invention in a third aspect, there is provided a 

method for scheduling the transmission time of multimedia objects comprising 
15 the steps of; 



Li 

i — 

* * ! 



^ a. dividing the transmission time into frames based on an object decoding rate; 

D 

b. further dividing the transmission time within each frame of the multimedia 
object channel into time slots, the number of time slots being equivalent to 
dividing the transmission rate by the multimedia object decoding time; 
20 d, forming a delivery time schedule of multimedia objects with a time stamp 
within the scheduled object delivery period or frame period; 

e. computing a scheduled object delivery period which is equivalent to the 
maximum object group delay period allowable; and 

f. re-scheduling objects that cannot be delivered within a current time slot to 
25 a later time slot. 
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According to the invention in a fourth aspect, there is provided an 
apparatus for interconnecting an object streaming apparatus into existing 
network interconnection apparatus to control data traffic generated by the 
multimedia object streams comprising: 
5 a. an ingress gateway to control entry of data packets into a network; 

b. a content traffic exchange hop attached to legacy switching or a routing 
network component; and 

c. an egress gateway to control the exit of data packets from the network and 
0 to stream content to end-users. 

SJ io The described embodiment of the invention uses a system 

□ 

y3 architecture that allows end-to-end streaming of time based objects. An input 
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jij data object from an object stream entering the network is marked and 

disassembled by an ingress object traffic controller. 

In the ingress object traffic controller, a large data object is 
15 fragmented into a plurality of smaller network data packets as specified by the 
chosen network layer for delivery. Each network data packet is marked 
according to the precedence level desired by the application entities at the 
source of the object stream. To provide the network data packets with linkage 
and real-time information, each object has an object descriptor created. Based 
20 on the real-time requirement and the network resources allocated for the 
delivery of the object stream, a time for an object frame is computed and 
created for the delivery of time-stamped object data. The data information of 
the object descriptor is mapped to the header of the network data packet where 
possible or is encoded into the payload. 
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At each of the intermediate nodes such as routers and switches 
connected with the apparatus, the data packet is received. The data packet is 
re-routed to the host using an egress object traffic controller if the data object 
has reached the final destination, otherwise the packet is processed by an 
5 exchange object traffic controller for re-transmission to another network node. 
In the egress or exchange object traffic controller, the object descriptor for each 
stream is collected and a timer circuit is spawned for each object stream. 

Based on the timing information, a system object frame is created 
dynamically and the number of time slots per object frame is computed. The 
10 time slots are used to mark the delivery time of the object data. The time 
schedule for the delivery of the object based on time slots is performed based 
on a traffic shaper or filter adopted for the stream. Object data meeting the 
criteria of the traffic shaper is put in the object stream queue and object data not 
1*7 meeting the requirement of the traffic shaper is stored in a cache memory for a 

H= 15 generalised lower priority object data scheduling. An object decoding period is 

UJ 

determined from the set of object stream descriptors received. One or more 
object decoding time slots are allotted for the object data to be delivered to 
meet real-time criteria in the stream object queue. After completing scheduling 
the object data that will expire within the object time frame in the stream object 
20 queue and data objects in the stream object cache memory are scheduled next. 
After the object has been scheduled, excess time slots are saved for future 
object frames. If there are insufficient time-slots, additional time-slots are 
allocated from the reserves to meet the need. If there are insufficient time-slots 
for delivery, object data that expires in the next object frame is discarded. 
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Data object packets scheduled for re-transmission are then re- 
assembled based on the output network criteria and a network header is 
mapped accordingly. The process is repeated for the data object in the 
exchange object traffic controllers of the intermediate nodes within the service 
5 provider domain until the final destination has been reached. 

The described embodiment of the invention provides an apparatus 
and a method for the delivery of scalable multimedia objects to meet real-time 
applications on a heterogeneous network. These scalable multimedia objects 
may contain synchronised audio, video and data information for interactive, 
p_ 10 communicative and broadcast applications over a wide area network. The 

□ described embodiment provides a multimedia objects streaming method based 

. 

Sj in network resource availability at each network component and it allows real- 
ms 

g? time end to end delivery of multimedia objects with minimal effect on the 
presentation quality of the multimedia object over networks with dynamically 

is 15 changing network resource parameters such as varying bandwidth, delay and 

* = i 

g latency jitters. The described embodiment provides a method and an apparatus 

^ that allows fast high level application data context switching and routing at the 

network layer. 

The described embodiment of the invention further allows the 
20 delivery of data without additional feedback from the receiver and thus cuts 
down on the complexity in the protocol needed by both ends of the users to 
handle a feedback report. The processing power needed for the client to 
perform the reporting based on the data received from the server is also 
reduced. 
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The described embodiment further provides a means to deliver 
real-time and near real-time multimedia object delivery of different decoding 
rates in a connectionless oriented connection accurately based on individual 
decoding rate. The described embodiment further allows synchronisation of the 
5 time based object streams such that real-time delivery specified for the object 
stream can be meet accurately without an accurate timer being implemented by 
the host network node. 

The described embodiment provides a mechanism to perform 
q network congestion avoidance at each intermediate network node dynamically 

d 10 at the rate equivalent to the smallest decoding rate from a set of decoding rates 
from the object streams and also allows link information between data packets 
belonging to the same data object to be retained as the data is being 
fragmented and delivered across the network. 

For real time delivery, the intermittent delay is kept at the 



m 



h* 15 maximum constant delay such that end to end delay for the arrival of all data 

W 

p objects is kept at a constant rate over time. 



The content data switching can be performed at the network level, 
thus freeing the application level from the rudimentary work of re-transmitting of 
content object data received. 
20 With the ability to couple fragmented data packets originating from 

a single data object, the described embodiment enables routers or intermediate 
network nodes between end-to-end users to drop data packets of the data 
objects with no presentation value. A data object without presentation value is 
one where the data object cannot arrive at the end user at the decoding rate. 
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This prevents non- preset data objects -sin, network congestion by 
dropping the said data objects. 

A , im er ,o improve synchronisation without the need for a central 
c^o, «me or network time protoco, to Keep synchronisation between network 
nodes is provided. The described embodiment allows an accurate means o 
stimate the decoding time - each object belonging to different obje« ^ 
Tne described emPodimen. aiso ailows a single network traffic 
droller to contro, object streams with d.erent traffc shaper or Bering 
algorithms. 

The described embodiment ailows the existing network 
juration to use the imp— apparatus to contro, readme traffic over 
' wid e area network such as the internet or corporate wide intranet. The 
ascribed embodiment a,so provides an infrastructure for the content provder 
,o stream AV content to the users in readme and the amount o, data objects to 
be deiivered to end used can varies depending on the profiie of the users on the 

can choose to stream content to their vaiued ciients with better quality o, serv.ce 
over the non-valued clients. 

BB1EE j3ESeB!EJJQtLQEJUEJBAWINSS 

An embodiment of the invention wi.l now be described, by way of 
example, with reference to the accompanying drawings, in which: 

FIG 1 illustrates the management of streamed data traffic from a 
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to the receivers at a content consumer via a service provider domain. This 
figure also shows the interconnections of content stream traffic control for the 
three domains for the management of network resources for the efficient 
delivery of content. 

5 Fig. 2A shows a preferred format of an object descriptor and Fig. 

2B shows a flowchart for creating a object reference from an input object stream. 

Fig. 3 is a block diagram of an ingress object traffic controller used 
in controlling the flow of real-time traffic into the network. 

Fig 4 is a block diagram of an egress object traffic controller and 
10 an exchange traffic controller used in the implementation of an egress network 
node and intermediate node for controlling the flow of real-time data. 

Fig. 5 is a structure of an object frame and the time slots within 
each object frame. This also illustrates the way the number of time slots can 
increase or decrease in accordance with traffic conditions. 
15 Fig. 6 illustrates a preferred implementation of a timer circuit of a 

W 

□ generic object traffic controller for the egress and exchange nodes. 

P 

Fig. 7 shows a detailed block diagram of object packet stream 
traffic control found in the object stream scheduler sub-block of the exchange 
object traffic controller. 
20 Fig. 8 shows a detailed block diagram of the time slot allocator 

found in the object stream scheduler sub-block of the exchange object traffic 
controller. 

Fig. 9 shows a flowchart of the method of scheduling object data 
in the time slot allocated for the object frame. This figure also shows how time 
25 slots not used for the current object frame are accumulated for future use. 



Ill 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The described embodiment of the invention provides a system 
and an apparatus for, and methods of, delivering multimedia objects for 
5 improved streaming at the multimedia content provider, improving the quality 
presentation at content consumer end and improving the network congestion at 
the service provider domains. The embodiment is described in the following in 
detail with reference to accompanying drawings. In the following description, 
numerous details are set forth in order to provide for thorough understanding of 
10 the described embodiment of the present invention by one skilled in the art. In 
some of the explanations, some obvious details that forms part of the 
embodiment are left out in order to not unnecessarily obscure the description. 

Fig. 1 is a diagram of an exemplary network system consisting of 
different network functional nodes for implementing the various aspects of the 

r 

P 15 embodiment of the present invention. This figure shows an additional network 
tf functional component being added to allow traffic control and management of 

data generated by the users in two domains: content producer 1 1 , and content 
consumer 110. The physical end-users can at different instances be in either 
the content consumer or content producer domains depending on the flow of 
20 the object stream. The entity that ensures the end-to-end delivery of object 
streams is the service content provider^ 5. The service provider domain 15 is 
connected to the content producer 11 via a network link 14, that shares the 
same type of network protocol and architecture as a first connected network 
switching element, 16. For brevity, the network component 16 is termed a 
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• k ■ - reoresentative network component for rooting of 
switching element which is a represent*! 

switching elements that support hop 
18 . to perform the function of ob,ect d ^ 

different end-.o-end users ,^^,6. 

exchange hop 18 before being passed back ^ 
lnm e content provider domain 11, traffic 

t , v 2 and is moderated by an ingress gateway, 13 to control the 
server en,,,, 1 ^nd , ^ ^ me term server- is 

traffic entering me serv,ce prov ^ ^ 

us ed to describe a ,ogical entty which ,s the source 

.««k The last switching element 16 in the servic 
across the network. The 

do main is connected to an egress gateway <^ 

dort ain 110, via an interconnect, 19, that shares the same yp 

protocol and architecture. ^ ^ ^ 

The content consumer domain 110 may 

n« These clients can ether have high bandwidth, 
„t network access proves. Th se ^ ^ 

11? or low bandwiatn, i "'^ 

- - — ■ — — 

revests from the server carried out by the dient. 
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Reference numeral 21 of Fig. 2A shows an exemplary descriptor 
used by multimedia objects these are sent to the network via an object 
fragmentor. The object descriptor 21 provides sufficient information for the 
object fragmentor to enable data packets belonging to the same object to be 
5 linked. Data packet linking is necessary as data objects from the application, in 
many cases if not all cases, need to be fragmented into smaller packets 
adapted for the network delivery layer before the objects can be delivered by 
the data carriers of the network layer. The descriptor includes a time value, a 
major object reference, a minor object reference, a decoding rate for the object, 

J3 10 a precedence offset for the object which provides priority of delivery information 

O and the object size. 

S .... 
Sjj The flowchart in Fig. 2B shows the method for providing time 

W 

ff\ information and linking of data packets for a fragmented multimedia object. For 

y: each transmission of object data, a session is set-up with the object fragmentor, 

15 22. The object fragmentation process is then carried out based on the 

i — 

'i? descriptor's decoding rate and precedence offset parameter at step 23. This 

S initialisation process allows the fragmentor to decide on the object marking 

value of the payload of the network delivery data packet. Based on the object 
descriptor and the network delivery payload size, the number of data packets to 
20 be linked is determined at step 24. Each of the data payloads for the 
fragmented object is then stamped with a unique major object reference number, 
a number which the object stream uses for the entire life cycle of the session. 
This major object reference number is incremented by one for each session 
created by the application with the object fragmentor at step 25. A minor object 
25 reference number is also created starting at one and incremented for each 
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packet of the object. For each data packet created from the object data, both 
the major and minor object reference numbers are stamped either as part of 
the data packet payload or packet data header or a representative of header 
information that the network data packet carries. The steps of stamping the 
data packet and packing of fragmented data into the payload of data packets 
are performed at steps 26, 27 and 28. When all the network data packets have 
been marked, the network data packets are time stamped, at step 29, with the 
same time value passed by the object descriptor. The object fragmentor will 
synchronise with coming object data if the decoding time rate is the same based 
on the time value in the object descriptor of the object reference. 

Fig 3 shows the block diagram of an ingress object traffic 
controller of the gateway 13 enabling marking and controlling the flow of object 
data entering the network. Object data enters the ingress object traffic 
H= controller with the object descriptor, 21, passed down from the application 

^ 15 entities. The object data is fragmented into smaller data packet payloads by the 
objector fragmentor, 35 based on the input network payload size, 32. For each 
data object divided into smaller data packets, the time is marked by the timer or 
time value in the object descriptor, 21 by the functional block 36. The timer 
derives it's time value from that of the descriptor, 21. An input decoding rate 
20 and the time value are fed into the timer block, 36, via the input 33 if the time 
values from subsequent object descriptors are the same. The timer value 
generated is fed into time slot divider, 38, where time slot transmission of object 
data time slots are created based on the bandwidth allocated for the delivery 
medium. Based on the time stamped on the data packets belonging to the 
25 same object, a time slot allocator 39 determines in which time slot the group of 
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j „ Dackets is t0 b e deiivered to fte network. For each data pacKe, to he 
data packets r packefew 

delivered, the data packet . mapped to a delivery 

mo du,e, 11 which translates the timing and the obiect reference o, the o*c, 
descriptor to the header o, the network data packet or encodes ,h,s as p art - 

sen t to a network parameter mapper module, 310 which encapsuia ,e .ft. 
Rented o,ect data packet into the format used tor delivery to ft. ne work 
ZLore ft. — netwo* packet is deiivered to ft. network de„very 

full functions of the egress object ft* controlier of the gatewa* , V I and. 
cont en, exchange ft. controller of fte content tra ffi c exohang^ a ™ 

1 42 F or each network data packet received, the data packet h^ 

parS ed and decoded b y the network parameter decoding funCon of block 45. 

The timin 9 information and fte object reference extracted from the header are 

passed for further processing to a timer circuit, 44. 

Another source of timing information and object reference number 
C3. be extracted from the payload by the network payioad de-packet- 
action of functional block 46. The timing and object reference are only 

dat a packets does not carry timing information and object reference numb.. 
Encoding of the timing information and fte object reference number ,n 
pay ,oad of the data packet follows fte o bj ect descriptor shown in F,g. 2A. 
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The timer circuit, 44, contains a time stamp for each object data 
packet received within the object decoding frame. A handle reference is 
created to provide a distinction between the various object data packets 
received based not only on the object reference number extracted from the 
5 object descriptor but also the source and destination network address and the 
numeral representative of the network service access point. For the timer for 
the object received to work accurately within each frame, the timers in block 44 
are updated or created by timing information from an object stream timer circuit, 
412. The timing information is also passed to a data de-fragmentor, 42 for 
10 accurate construction of a data stream if the data stream received has reached 
the final destination. For the object stream received, the stream is further 
processed by an object stream classifier, 410, to determine a final destination of 
the object stream based on the unique handle reference. If the object stream 



^ has reached the final destination, the data packets are passed to the object de- 

p 15 fragmentor, 42. In order for the object to be re-assembled and later fed to the 
buffer used for object decoding, timing information from the timer circuit 412 
which keeps the timers for the object stream received within one object 
decoding time frame is required. 

In order for the host network components such as switches and 
20 routers to perform the function of a content exchange traffic controller, the 
functional sub-blocks in the object stream scheduler block, 47, are required. 
The internal clocking of the timer referenced by the unique handle reference 
providing all the accurate time keeping is kept by the object stream timer circuit, 
412. This contains timing information for the object stream to be re-routed to 
25 another destination. For each stream received, the delivery time slots for each 
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object data packet, based on each individual object stream decoding timing 
requirement and the transmission time required, are computed by a time slot 
divider, 411. In addition, divider 411 also provides an object packet stream 
traffic control, 48 with the object descriptor constructed from the data packet 
5 received via the network parameter mapper and decoder functional block, 45. 
Based on all of the information computed for each object stream of the time slot 
divider, the object stream traffic control, 48, then decides the time required for 
the final delivery of the object stream. Based on the precedence of the object 
p stream carried in the object descriptor of each object stream, the time slot 

HP 

%i 10 allocator 49 performs the final decision as to how the object data fragmented 
;p into data packets is delivered out to the network via the functional block 46. 

^ Timing information of the data object stream that is scheduled to be transmitted 

t y 

^ : is performed by a system time slot divider, 43, which gathers all the information 

^ of each time slot divider 411 assigned to each object stream to determine a 

15 minimum object decoding time. The number of time slots for the node is 

W 

p determined by equation eq. 2 below. An object frame is determined by the 
system time slot divider in accordance with equation eq. 1 below. 



Object Frame = 

20 Min(DecodingRate ot(|ect strBam 1t DecodingRate ONedStream2 ,.. ,DecodingRate Qbject 

Stream n) (EQ- D 

System time slot divider 43 performs and maintains a universal 
object frame for the content exchange traffic controller based on the network 
25 resources allocated for transmission. The network resources may include 
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bandwidth, latency and total packet group delay. Information generated by 
divider 43 is also synchronised with the time slot allocator 49, such that the 
same timing information can be mapped to the network data header or encoded 
in the payload of the network packet carried out by the functional block 45. 
5 To enable the exact transmission time of the object data to be 

transmitted out at the egress node or content traffic exchange hop, a time frame 
called the object frame is assigned for the object streams to be transmitted out. 
The pre-allocated time period for the object frame is equivalent to the time for 
decoding one object data as described in the object descriptor. In the case 
10 where there is a requirement to use more or less bandwidth, the object frame 
q period can be increased and reduced. Each object frame may consist of more 

than one time slot depending on the bandwidth allocated for the delivery of the 
object data. Depending on the amount of transmission bandwidth allocated, the 
|7 object frame may contain more than one time slot. The number of time slots 

15 per object frame can be computed as follows:- 



III 

m 



UJ 

p 
o 



No. of Time Slots (n) = Transmission rate/Object Decoding rate 

(EQ. 2) 

20 For each object frame, only an integer number of time slots is 

allowed. In the case of a non-integer value as a result of eq. 2, an additional 
time slot may be allocated for each time object frame if the sum of the fractional 
portion of time slots calculated forms a value more than one accumulated over 
a number of object frames. The rate of additional time slots in terms of object 

25 frame is inversly proportional to the fractional portion of the computed time slots, 
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n, derived from eq. 1 . Fig 5 shows the organisation of object frame, 51 and time 
slots, 52. In the case where n is a fractional number, the transmission of the 
object frame is scheduled earlier than the time frame bounded by the object 
decoding rate, as in, 54. Over several object frame periods, when the fractional 
5 portion of the time slots accumulates more than one, one additional time slot, 55, 
would be allocated for the object frame marked by 54. The allocation of time 
slot marked by 55 is strictly based on the needs determined by module 48 of the 
block diagram in Fig. 4. The time frame of the object frame is dynamically 
jjj updated by the object descriptor at the rate equivalent to the arrival of the 

g 10 network data packet of the object data. 

The calculation of an elastic delay is performed by equation 1 and 
2. With the preset delay being set by higher application software or set at pre- 
configured time, the time slot can choose which decoding frame the object can 



FU 

m 



H 8 start transmitting. The subsequent object of the same reference must be 

Ly 15 transmitted within the object decoding time or less. Each node can have a pre- 

P 

p configured delay for the object stream of a specificed object reference. 

The preferred implementation of the timer as mentioned in blocks 
44 and 412 of Fig. 4 and 36 of Fig. 3 is illustrated in Fig. 6. This implementation 
of the timer is used to provide synchronisation between network components. 

20 Each time a timer instance is instantiated, a timer session is created at step 61 . 
An individual timer instance provides a means to insulate the time reference 
from other object stream object references. The timer is updated with the timing 
information from the object descriptor, at step 62. The time value in the object 
descriptor provides the reference decoding time of the object data. All object 

25 references with similar major reference number and with the same source and 
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destination address w wUhjn (he same 
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perUcular object Terence stream ^ ^ ^ ^ 

required for the object reference. or ^ 

th» timer resolution adopted by me 

ha rdware -* The-- ^ ^ _ object stream 

Deltajime at step 625. As wjth 

session is deleted if the object stream 

transmission, at step b. t> , • djvjderi tjme 

Based on the information from the system t.m 

^ scheduling of the data 

. arbitrary number of Input object trafKc 
R eference numer 7 ^ ^ ^ ^ ^ ^ 

— enttnn9 me ° " stream object descriptor and «. information 

° fr0m " scan for k «*- streams. 7, by the 
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25 stream object slot schedUer. the multiplexer a>so ,eeps 
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object stream, as shown in the data structure below. This allows feedback for 
the dynamic mechanism required by the traffic shaper or filter. 

Object Stream Statistic { 

Max Object Size in Bytes; 
Min Object Size in Bytes; 
Average Decoding Rate; 
Total Objects received; 

} 



In a preferred form, the multiplexing sequence starts from the 
object stream with the least decoding rate of 71 and the other precedence 
classifications then follow. 

Fig. 7 shows the detailed description of the object packet stream 

{ — 

ft 15 traffic control. The object stream shaping block 73, performs filtering based on 

g the object data size, the rate of entry and the precedence of each of the objects 

Lj. 

received from one single stream. The detail of the shaping algorithm can vary 
depending on the rate of decoding. For the data that meets the filter criteria, 
reference to the data. object is passed to stream object slot scheduler, 74. The 

20 stream object scheduler then assigns the object to the time slot to deliver the 
object within the decoding rate as specified in the object descriptor. The time 
slot schedule information which refers to the object delivery time, in terms of 
time slots, is passed to the time slot allocator. References of data objects that 
did not meet the filter requirements are passed to an object cache control, 75 

25 where information of the cache for the object is passed to the time slot 
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allocators stream object cache memory of Fig. 8. The object streams in the 
cache memory are object precedences of lower level which should not be 
transmitted because the capacity for the stream has reached the assigned 
bandwidth according to the filter in the object stream shaping block 73. 

Fig. 8 shows a functional diagram of the time slot allocator. 
Reference numeral 81 represents an arbitrary stream traffic received. The 
object frame created by the time slot allocator is based on the assigned 
transmission bandwidth and the minimum decoding rate determined from 
system time slot divider, 43. The time slot schedule information from the object 
stream traffic control, 48, determines if the data selected by the object stream 
multiplexer should put the object on a stream object queue, 83 or a stream 
object cache memory, 85. Based on the queue information from the stream 
object queue and the stream object cache memory, the object is slotted into the 
time slot of the object frame. Slotting of object data into a time slot is performed 
by a object to time slot mux, 84. Because of its finite memory size, the stream 
3 object cache memory 85 may choose to discard the longest staying data 

B objects if the memory assigned is used up. If there are free time slots after all 

the object in the stream object queue as been allotted, the data object in the 
stream object cache memory is multiplexed out via the object to time slot mux, 
20 84, to be delivered out to the network. The minimum queue size for each 
stream should not be less than the entire object frame size. The total memory 
assigned for the object stream in both cache memory and queue memory 
should not exceed the following to meet the total group delay for one node; 
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„ & Cache) = Group Delay X (max. Obiecl Size / 
Memory Size (Queue & Cache) 

(EQ. «3) 

Decoding Rate) 

, , Helav to be supported, the group delay vaiue of 
Spending on the amount - delay* b P ^ ^ ^ ^ ^ 

each node need to be updated such that re a ^ ^ 

M recomputed. ^ recomputed memo. s,ze us,ng eo, 

maximum group delay per hop. dvnamic aWy by the functional 

each object frame computed dynamically y 
For eacn ooi controller, a 

- — ;r . — - - - 

in eq. 1 and eq. 2. The allocat ion of time slots be.ng 

- all objects based on th a ^ ^ ^ , 0 be 

- P ^ nCe I preference o, one sKilled in the an. At step 

dewered is ::7ei:i I: «- - - - - ■** - 
9rme :: o rnits „ «*- * ««— *~ * ,he 

el n , , Object data to be delivered .thin the object frame ,s 
determined at step a* oa 

, have data ob ects that do noi me 

total time the object data packets res,des m the ou 
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rate of the object stream. Schedule time (t) is defined as the total time spent in 
the queue and time spent if the object is delivered in the next object frame. If 
the schedule time (t) is larger than the decoding rate of the object, this means 
that the data object needs to be delivered in the current object frame. If 
5 additional time-slots are required within the object frame, a check is made at 
step 97, if there are additional time slots saved over from the previous object 
frame. The additional time slots re-allocated are updated at step 98, which 
keeps a record of global time slots reserved over an arbitrary period of time. 
With the excess time slots, data objects in the stream object cache memory are 

P 

*fi io scheduled for delivery next, performed based on criteria in step 99. Assignment 

N 

O of data objects based on the allocated time slots is performed in 910. After all 

SJ objects with the decoding time frame have been assigned, the remaining time 



oi slots for the object frame are saved for future object frames at step 91 1 . 



The thus described embodiment of the invention provides system 
u 15 architecture for the apparatus as described in the object traffic controller to be 



configured and connected to any legacy network structure for end-to-end 
delivery of real-time data. The apparatus provides a real-time mechanism for 
the content switching based on timing requirement of individual data streams at 
the network node performing the routing and switching functions. Network 

20 congestion is avoided by discarding object data which may consists of a 
number of network data packets if the real-time requirement failed to be 
observed due to heavy network traffic. Discarding objects failing real-time 
requirement allows efficient use of network resources and also provide an 
indicator to higher layer software that the bandwidth is insufficient for the 

25 session. It also enables the network components to operate in a collaborative 
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effort in streaming real-time traffic through a targe network. 1. also frees up the 
additional resources required a, the client terminals to implement sophisticated 
protocol stack for providing feedback based on the traffic received. In addiUon, 
,he system allows real-time with high timing accuracy to be delivered across a 
wide area network without dras«c change to the existing network architecture. 
The client can receive quality content with graceful degradation when there is 
network congestion or when the bandwidth to the client reduces due to heavy 
utilisation of network resources or se^er resources. On the service and content 
provider ends, it provides an infrastructure and means to difference the real- 
time services provided for the client based on client's profile. This invention ,s 
S very useful in delivering real-time data across heterogeneous network to light- 

3 weight dient with limited network resources and processing power such a 

^ mobile PDA or mobile video terminal. 

£ The present disclosure relates to subject matter contained in priority Singapore 

U Patent Application No. 200000085-1 . filed on January 7, 2000, the contents of which is 

Q 

D herein expressly incorporated by reference in its entirety. 
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